An obstacles avoidance method for serial manipulator based on reinforcement learning and Artificial Potential Field
نویسندگان
چکیده
Abstract The obstacles avoidance of manipulator is a hot issue in the field robot control. Artificial Potential Field Method (APFM) widely used path planning method, which has prominent advantages. However, APFM also some shortcomings, include inefficiency avoiding close to target or dynamic obstacles. In view shortcomings APFM, Reinforcement Learning (RL) only needs an automatic learning model continuously improve itself specified environment, makes it capable optimizing theoretically. this paper, we introduce approach hybridizing RL and solve those problems. We define concepts Distance reinforcement factors (DRF) Force (FRF) make integrated more effectively. disassemble reward function into two parts through DRF FRF, them activate different situations optimize APFM. Our method can obtain better performance finding optimal strategy by RL, effectiveness proposed algorithm verified multiple sets simulation experiments, comparative experiments physical types superior traditional other improved collisions approaching avoidance. At same time, verify practicality algorithm.
منابع مشابه
Obstacle avoidance for an autonomous vehicle using force field method
This paper presents a force field concept for guiding a vehicle at a high speed maneuver. This method is similar to potential field method. In this paper, motion constrains like vehicles velocity, distance to obstacle and tire conditions and such lane change conditions as zero slop condition and zero lateral acceleration are discussed. After that, possible equations as vehicles path ar...
متن کاملVisual Avoidance of Moving Obstacles Based on Vector Field Disturbances
In this paper, we propose a new method for real time obstacle avoidance using visual information. It is based on our on-going research on vector fields and potential functions associated to successful motion planning algorithms. Specifically, this paper addresses the avoidance of dynamic obstacles, which have the property of producing instabilities in the navigation vector field associated to a...
متن کاملDynamic Obstacle Avoidance by Distributed Algorithm based on Reinforcement Learning (RESEARCH NOTE)
In this paper we focus on the application of reinforcement learning to obstacle avoidance in dynamic Environments in wireless sensor networks. A distributed algorithm based on reinforcement learning is developed for sensor networks to guide mobile robot through the dynamic obstacles. The sensor network models the danger of the area under coverage as obstacles, and has the property of adoption o...
متن کاملReinforcement Learning for Multi - Linked Manipulator Control
We present an automatic trajectory planning and obstacle avoidance method for a multi-linked manipulator which uses position and velocity sensor information directly to produce the appropriate real-valued torques for each joint. The inputs are fed into a Cerebellar Model Arithmetic Computer (CMAC) [1] and in each state, the expected reward and torques for each joint are learnt through self-expe...
متن کاملAn Artificial Economy Based on Reinforcement
In this paper, we employ techniques from artificial intelligence such as reinforcement learning and agent based modeling as building blocks of a computational model for an economy based on conventions. First we model the interaction among firms in the private sector. These firms behave in an information environment based on conventions, meaning that a firm is likely to behave as its neighbors i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International journal of intelligent robotics and applications
سال: 2021
ISSN: ['2366-5971', '2366-598X']
DOI: https://doi.org/10.1007/s41315-021-00172-5